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The Parallel-Sequential Duality : Matrices and Graphs. 

Abstract. Usually, mathematical objects have highly parallel inter- 
pretations. In this paper, we consider them as sequential construc- 
tors of other objects. In particular, we prove that every reflexive 
directed graph can be interpreted as a program that builds another 
and is itself builded by another. That leads to some optimal memory 
computations, codings similar to modular decompositions and other 
strange dynamical phenomenons. 

1. Introduction. 

In this paper, we will deal with matrices and finite directed graphs G — (V, A) 
where F is a finite list {xi,X2, . . . , x„) of vertices and A is a subset oi V x V 
of arcs. 

Usually, in classical mathematics, matrices are highly parallel objects. For 
computing the transformation of a vector X by a linear mapping X :— E{X), 
a mathematician first keeps the initial vector X in mind or in a safe place, and 
then computes the successive images of each component of X by the projections 
of E. Equivalently, he can also compute Y := E{X) and then X :— Y. In both 
cases, one seems to have to build a copy of the initial vector X in order to 
preserve its initial values for the whole computation that will modify these 
values. Hence, the data size for this kind of computation processes is twice the 
size of the input data X . A motivation of this paper is to show that one can 
compute the transformation X := E[X) without any copy. In [1], we proved a 
similar result for the computation of boolean mappings. Here, we will interpret 
matrices as sequential programs that perform sequences of assignments on the 
components of the initial vector. In general, the mapping computed by this 
way is not the usual linear mapping represented. Now, a matrix admits a 
usual parallel interpretation and a sequential interpretation. We are going to 
investigate this duality. 

Definition, (matrices). Let K be a field. Given a square matrix M of 
Mn,n{K), Mi is the z-th row vector of M and M^j is the j-th component of 
the row Mi. The matrix M is said regular if it only has Is on its diagonal, i.e., 
Mi,i = 1 for every i. A matrix M' of Mn^n{K) is similar to M if it has the same 
values than M excepted possibly on the diagonal, i.e., M[ ^ ^ Mij i = j. 

First, we recall the classical interpretation of a matrix in linear algebra. 

Definition, (parallel mapping). Let be a field. Every square matrix 
M of Mn,n{K) represents a linear mapping M^^ from K"^ to A'" that we will 
call the parallel mapping of M and defined by the following. For every X — 
(xi, . . . ,x„) G A", the parallel image of X by M is the vector 

M*{X) = (A/i.A, M2.X, . . . , Mn.X) 
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This mapping M* can be computed by the foUowing straight-line program : 

Input : X = {x\, . . . , Xn) 
For i from 1 to n do 

n 

Output : Y = 



2. Sequentializing. 



Now, we define a dual interpretation of a matrix in linear algebra such that the 
image of a vector X can be computed via a sequence of linear transformations 
of this vector X and only using this vector for the whole computation. We 
obtain an "in situ" straight-line program. 

Definition, (sequential mapping) . Let -FsT be a field. Every square matrix 
M of Mn,n{K) represents a linear mapping from K^^ to called the 
sequential mapping of M defined by the following. For every X = (xi, . . . , a;„) € 
K^, the sequential image of X by M is the resulting vector computed by the 
following straight-line program denoted : 

Input : X =■ (x\ , . . . , a;„) 
For i from 1 to n do 

n 

Xi . ^^^Alj^ j.Xj 

Output : X = {xi , . . . ,Xn) 

Denote the matrix such that (M^)# = M^. 



As we said above, one only uses the input vector X for the computation of the 
sequential image, whereas in the standard parallel interpretation, one uses a 
second vector Y (in order to preserve the values of the input vector X). 

For example, for K = M., the sequential mapping of the matrix 



M = 



1 2 

3 4 5 
6 7 8 



maps every vector (a, b, c) to (6+ 2c, 76+ 11c, 556+ 97c) since the corresponding 
sequential program M'^ is : 
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a := 0.a+ 1.6 + 2.C 
h := 3.a + 4.6 + 5. c 
c := 6.a + 7.6 + 8.c 



(=6+ 2c) 
(= 3(6 + 2c) + (46) + (5c) = 76 + 11c) 
(= 6(6 + 2c) + 7(76 + 11c) + 8c = 556 + 97c) 



and one has : 



1 2 
7 11 
55 97 



The sequential interpretation of a matrix leads to a natural notion in the con- 
text of directed graphs. 

Definition, (graph construction). Let G = {y,A) be a finite directed 
graph where F is a finite list (xi, 2:2, . . . , x„) of vertices and A is a subset of 

V y V oi arcs. We say that G sequentially constructs a directed graph G' when 
their respective adjacency matrices M, M' in M„^„(F2) satisfy : 



That is a kind of decomposition of a graph. Instead of working with a graph G, 
one can consider a sequential constructor of G or the graph that G constructs. 
We will see in the sequel some advantages. We are going to study the relations 
between these graphs and first of all, their existence. Given a graph G, is there 
another graph G' which is a sequential constructor of G ? We will see that the 
answer is NO. However, if one assumes the graph G to be reflexive, the answer 



In the formalism of matrices, observe that by definition, the parallel interpre- 
tation of is equal to the sequential interpretation of M. For the other 
direction, a natural question is : 

given a matrix M . is there a matrix P with a sequential interpretation equal to 
the parallel interpretation of M ? 

Unfortunately, the answer is NO in general. A minimal example for K = F2 
is : 



If there were a matrix P such that P ^ = M# , since P and M have necessarily 
the same first rows (i.e.. Pi = Mi), the matrix P must be some 



= M' 



is YES. 




ki k2 
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and the sequential program : 
a := 

b := ki.a + k2.b 

should transform every vector (a, b) in (0, a) : that is not possible. 

However, we are not very far from a positive answer with the following prelim- 
inary result. 

Theorem 1. Let K be a Held. For every linear mapping E from K" to -RT" 
with n > 0, the assignment X := E{X) is computed by a straight-hne program 
P made of at most 2n — l linear assignments of the components of X . Moreover, 
the n first steps of P form a program for a matrix M in Mn,n{K)- 

Proof. We construct the code of the program P in two parts. 

Part 1. 

Let M be the matrix such that M# = E and let P be the empty pro- 
grsLin. 

For i from 1 to n do 

case 1 . If Ma ^ 
Let Ti := 

Add to P the instruction [xi := Mi.X] 
For every k> i with Mki ^ do 

Mfe := Mk + Mki.Mr:^.{xi - Mi) 

case 2. If Mu = and for every j > i, Mji = 
Let Vi := 

Add to P the instruction [xi := Mi.X] 

case 3 . If Ma = and there exists some j > i with Mji ^ 

Let rt := j for such a chosen j. 

Add to P the instruction [xi := {Mi - Mj).X] 

For every k > i with Mki ^ do 

Mk := Mk + Mki.{-Mji)-\{xi -Mi + Mj) 

Part 2. 

for i from n — 1 downto 1 do 

If Ti = j > i then add to P the instruction [xi := Xi + Xj\ . 

4 
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We prove the correction of this method, that is to say, that the program P 
produced computes the transformation X := E{X) for every X G . 

In Part 1, assume that at each step i = 1, . . . ,n the rows M^,. . . , Mn represent 
the respective images by E of the components Xi,...,XN according to their 

current vahics at step i. That is true for i = 1 because M# = E. At step i, 
the program makes an assignment of Xi. 

In case 1, Ma ^ and Xi receives the new value a.Xi + b where a — Ma ^ 0. 
Hence, the initial value of Xi is not lost and was a~^.{xi — b) where Xi is its 
new value. In order to preserve the hypothesis on M, one has to replace the 
references to the initial Xi by this new linear function a^^.{xi — b) in every 
for fc > i. Hence every M/. = Mi-iXi + F with k > i and M^j ^ should become 

Mk^.a^^.ix^ -b)+F ^ Mk^.a^^.{x^ - Mi + a.Xi) + F 

= Mki.a-'^.{xi - Mi) + Mki.Xi + F 
= Mki.MrrKixi - Mi) + Mk 

In case 2, Ma = and M~^^ does not exist. Hence, the previous adjustment is 
not possible. However, this operation is not necessary since the old value of Xi 
is used in no Mj for j > i. 

Case 3 is more critical. The old value of Xi will be used again in some Mj with 
j > i but a direct assignment of Xi would make impossible to recover it because 
Ma = 0. The adopted solution here is to first transform Mj in M^ = Mi — Mj 
in order to fail in case 1 since M/^ = —Mji 0. The correction will be made 
in Part 2. 

In Part 2, assume that for each i = n — the components x^+i, . . . , a;„ 

have received their correct values. That is true for i = n — 1, since the assign- 
ment of Xn in Part 1 cannot fail in case 3 because i = n is maximal (there is no 
j > i). Hence .t„ has received its correct value by hypothesis in part 1. If for i 
such that Ti = j > i,hy hypothesis, Xj has received its correct value Ej. Hence, 
the assignment Xi := Xi + Xj will perform Xi := Xi + Ej = Ei — Ej + Ej = Ei 
and Xi also receives its correct value. ■ 

Observe that the Part 1 of the produced program P is exactly the sequential 
program M^ and in Part 2 all the assignments are quite simple and have the 
form 

Xi . — Xi ~{~ Xj 

Hence, one can code Part 1 with the matrix M and Part 2 with the list of 
numbers [ri, r2, . . . , r„]. 

For example, let us compute the program for the linear mapping : 
with E{a, b,c) = {c,a + b + c, 3a + 3b + 2c) 

For i = 1, one has Mn = and we fall in case 3 since M21 7^ (and also 
M31 ^ 0). One chooses for instance j = 2 and remember that for Part 2 with 
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ri := 2. Then performs Mi = Mi — M2 = [—1, —1,0]. The first assignment 
of the program is a := —a — b. Then M2 becomes [—1,0, +1] and M3 becomes 
[-3,0,2]. 

For i = 2, M22 = and we fall in case 2 since Ms2 = too. The second 
assignment of the program is b := —a + c. And M3 remains equal to [—3, 0, 2]. 

For i = 3, we are in case 1 and the third assignment of the program is c := 
-3a + 2c. 

In part 2, the only assignment added is a := a + 6. Finally, the computation 
program P is 



a := 
b :-- 
c := 



-a — b 
-a + c 
-3a + 2c 



a := a + b 

One can verify that P computes X := E{X). 
Begin with X = [a, b, c). 



a := —a — b 
b := —a + c 
c := —3a + 2c 
a := a + b 



a 

—a — b 



X 
b 

a + b + c 



3a + 3b+ 2c 



From every X = (a, b, c) 
3b + 2c) as expected. 



the program ends with X = (c, a + 6 + c, 3a + 



The only problem for sequentializing is Case 3 that forces an adaptation in 
Part 2. Hence, one needs a larger structure than matrices themselves in order 
to code this sequentializing : for instance, a matrix AND the list of numbers 
rj. In the previous example, a possible coding of the sequentializing of 



is : 



1 

1 1 1 

3 3 2 



[2,0,0] 



For another example, the sequentializing of 



M 





1 
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leads to the following straight-line program : 



a := —a 

b := —a 
a := a + b 



and a possible coding is : 



-1 
-1 



[2,0] 



Now we consider matrices up to reflexivity (i.e., up to their diagonals). With 

this restriction, the previous scqucntializing method can be simplified such that 
only Cases 1 occur. Hence, the sequentializing program is only made of n steps 
where n is the dimension of the given matrix (or the graph). 

Theorem 2. Let K be a Held. Let M be a matrix in Mn,n{K). There exists 
a regular matrix '^M in Mn,n{K) such that '^M^ is similar to M. 

Proof. The construction is similar than in the previous proof. However, the; 
adjustments consist in the replacement at step i of a critical case Mj^j = 
by forcing Mj_j := 1. We explicit now this procedure in the particular case 
K = F2. 

Begin with "^M = M and P is the empty program. 
For i from 1 to A'' do 
Set '^Mi^i := . 

Add to P the instruction [xi := Xi + '^Mi.X] 
For every k > i with '^Mki = 1 do 

'^Mfc := '^Mk + '^Mi 



Set '*Mi,i := 1. 

As previously, the construction implies that at each step i, the rows '^A'/^, . . . , ''M„ 
represent the images (up to reflexivity) of the initial vector according to its cur- 
rent values. ■ 



For example, for 





"0 


1 


1 


M = 


1 


1 







1 





1 



one obtains : 
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for i = 1, one adds to P the instruction \a := a + b + c] and ''M becomes 



1 1 



for i = 2, one adds to P the instruction [b :— a + b + c] and '^M becomes 



1 1 1 
1 1 1 
1 1 



for i = 3, one adds to P the instruction [c := 
We have obtained the regular matrix 



where 

is similar to M. 
3. Dynamics. 



1 1 1 
1 1 1 
Oil 



1 1 1 

1 
1 1 



Some strange dynamical systems can be deduced from the above. Let G be a 

reflexive directed graph. Hence its adjacency matrix M is boolean and regular. 
Let us construct the sequence of matrices M = Mq, Mi, M2, . . . where Mj+i = 
'^Mj. By construction, these matrices are all boolean and regular. Since the 
set containing these matrices is finite, there must exists some cycle, i.e. some 
pair < p < q with Mp = Mq and where p is taken minimal. 
We claim that p = 0. 

Observe that this sequence of matrices can be constructed in the other direction. 
From Mi+i, build the matrix Alf^^. With the previous result, M-^^ = '^M- is 
similar to Mj. But Mj is regular. Hence, by putting only Is on the diagonal 
of M?^_j, one obtains a deterministic way to transform M^+i to Mj. Denote (j) 
this mapping on regular matrices that takes a matrix M, computes and 
puts Is on its diagonal. 

Now assume that p > 0. The matrix Mp would satisfy ^{Mp) = Mp_i and 
(f){Mp) = Mq. Since ^ is a mapping, one obtains Mp_i = Mq : a contradiction 
with the minimality of p. 

For example, the maximal cycle on matrices of M4_4(F2) has length 18 and 
from the matrix : 



8 



S. Burckel 



The Parallel-Sequential Duality : Matrices and Graphs. 



Mo = 



- 1 


I 


I 


I 


I 





I 




I 


I - 


1 


1 


1 





1 


1 








1 








1 


1 





1 








1 





1 








1 


1 


1 


1 


1 








1 











1 


1 


1 


1 





1 


1 


1 


1 











1 








1 


1 





1 





1 


1 





1 








1 


1 


1 





1 








1 


1 








1 


1 








1 


1 


1 


1 


1 


1 


.1 








1 


1 


1 











1. 



one obtains a cycle of length 13122. 
4. Relations. 



We have seen that there exist matrices M that do not admit some matrice P so 
that = M. However, every matrix M has a unique sequential mapping MK 
Hence there exist pairs of matrices (P, P') that construct the same matrix. Let 
us investigate in this paragraph these relations. 

Definition, (equivalence). Two matrices M,W are sequentially equivalent 
if their sequential mappings and are equal. 



For example, the two matrices of M4,4(I 



M = 



12 3 4 
10 
10 
10. 



W = 



12 3 4 

10 

10 

1 0. 



are sequentially equivalent since the two mappings and are equal to 
{a,b,c,d) H^. {a + 2b + 3c + 4d,a + 2b + 3c + 4d,a + 2b + 3c + 4d,a + 2b + 3c + 4d) 
However, their sequential programs are different : 

a:=a + 2b + 3c + 4d a := a + 2b + 3c + 4d 



b := a 
c:=b 
d:= c 



■ a 

■ a 
■■ a 



Of course, this notion can be exported in the context of directed graphs. 

Definition, (equivalence). Two directed graph G,G' are sequentially equiv- 
alent if they sequentially construct the same graph. In that case, we write 
G = G'. 
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Proposition (chains). Every directed graph G = {V = {xi, . . . , Xn),A) that 
admits an induced subgraph H on vertices {xp,Xp+i, . . . ,Xq) which is a chain 
(i.e., {xi+i,Xi) € A for p < i < q), is sequentially equivalent to the graph 
G' where an arc {xi^i,Xi) of this chain is replaced by an arc {xi^i,Xj) with 
p < j < i + 1. 

Proof. The corresponding sequential program performs : 

Xp+2 '■= Xp+i 
Xp+3 := Xp+2 



Xq . Xq—l 

and computes the same mapping than the program : 



Xp+l 


:= X 


Xp+2 




Xp+3 


■.= x 


Xq .— 


Xp 



For example : 




The complexity of graphs can be considerably reduced up to sequential equiv- 
alence. For instance, when a graph contains a maximal directed acyclic sub- 
graph. 

Proposition (linear orders). Every directed graph G = (V ^ {xi, . . . , Xn), A) 
that admits an induced subgraph H on vertices {xp,Xp^i, . . . ,Xq) which is a 
linear order (i.e., {xj,Xi) G A for p < i < j < q), is sequentially equivalent to 
the graph G' where one removes all the arcs of H excepted the arc (xp+i, Xp). 

Proof. The corresponding sequential program performs : 

Xp-\-l • — Xp 

Xp-\-2 • — '^p+l ^" Xp 

Xp+3 := Xp+2 + Xp+i + Xp 
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Xq := Xq-l + . . . + Xp+2 + + Xp 

and computes the same mapping than the program : 



Xp+l 




Xp+2 





Xp+3 


:= 



Xg:=0 U 

For example : 




5. Conclusion. 

The sequential interpretation of matrices we presented here is a powerful tool 
for computations of linear transformations X := E(X) using minimal memory : 
one only uses the input data memory X for that computation. In the case 
of graphs, and more generally directed graphs, the sequential interpretation 
defines a graph decomposition : roughly speaking, every vertex of rank i can 
"use" the connecting work of vertices of ranks j < i. Moreover, sequential 
equivalences in graphs enable some simplifications in the codings. A complete 
axiomatization of these relations could be done. 

Under a dynamical system point of view, iterating sequential interpretations 
leads to strange phenomena which should also merit particular investigations. 

Let us mention that other choices of construction are possible. Here, the se- 
quential constructor '^M of a matrix M is chosen to have only Is on its diago- 
nal. However, every sequence of invertible elements in the field K is possible. 
Moreover, similar constructions can be done on finite sets in general. We have 
seen here two sequential decompositions of a linear mapping on JsT". The first 
one consists in 2n — 1 steps where the last n — 1 steps are quite minimal and 
coded by assignments Xi := Xi + xj with j > i or by a sequence of integers 
[ri,r2, . . . ,r„_i]. The second one just consists in n steps but the diagonal of 
the matrix can be modified. Let us propose a third possibility, still in n steps, 
where each row of the matrix is completely preserved. However, the order of 
the rows may change : during the process, when Mi^i = and there exists 
j > i with Mj^i 7^ 0, then exchange the two rows Mi and Mj and proceed like 
in the two other methods by substitution. Now, the coding of the result is a 
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new matrix and a permutation a of Sn- This method preserves the informative 
structure of the mapping. The similar operation on directed graphs, up to a 
permutation of vertices, preserves the numbers d" (x) of incoming arcs to each 
vertex x. More precisely, there exists a permutation of vertices a such that ev- 
ery arc {x, y) is transformed in an arc {(t{x), y). The semantic of this operation 
also merits other investigations. 
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